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Abstract 

Responses have been numerically studied of an ensemble of (=1, 10, 
and 100) Hodgkin-Huxley (HH) neurons to coherent spike-train inputs ap- 
plied with independent Poisson spike-train (ST) noise and Gaussian white 
noise. Three interrelated issues have been investigated: (1) the difference 
and the similarity between the effects of the two noises, (2) the size effect 
of a neuron ensemble on the signal-to- noise ratio (SNR), and (3) the com- 
patibility of a large firing variability with fairly good information transmis- 
sion. (1) The property of stochastic resonance (SR) for ST noise is shown to 
be rather different from that for white noise. When SNR for sub-threshold 
inputs obtained in our simulation is analyzed by the expression given by 
SNR = 10 logio [(^/-^") 6xp(— i?/X)] where X expresses the noise intensity 
and A and B are constants, the index a is q = 3 for the ST noise and a = 2 
for the white noise: the former is different from the conventional value of 
a = 2 realized in many non-linear systems. ST noise works less effectively 
for SR than white noise. (2) The transmission fidelity evaluated by SNR is 
much improved by increasing A^, the size of ensemble neurons. In a large-scale 
neuron ensemble, SNR for supra-threshold inputs is shown to be not signif- 
icantly degraded by weak noises responsible to SR for sub-threshold inputs. 
(3) Interspike intervals (ISIs) of output spikes for sub-threshold inputs have a 
large variability (c^, ~ 0.8), which is comparable to the data observed in cor- 
tical neurons. Despite variable firings of individual neurons, output signals 
summed over an ensemble may carry information with a fairly good SNR by 
the aid of SR and a pooling effect. 
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I. INTRODUCTION 



It has been controversial how neurons communicate information by spikes Much 
of debates on the nature of the neural code has been mainly focused on the two issues. The 
first issue is whether information is encoded in the average firing rate of neurons {rate code) 
or in the precise firing times {temporal code). Andrian first noted the relationship between 
neural firing rate and stimulus intensity, which forms the basis of the rate code. Actually 
firing activities of motor and sensory neurons are reported to vary in response to applied 
stimuli. In recent years, however, the alternative temporal code has been proposed in which 
detailed spike timings are assume to play an important role in information transmission: 
information is encoded in interspike intervals (ISIs) or in relative timings between firing times 
of spikes |]T^. Indeed, experimental evidences have accumulated in the last several years, 
indicating a use of the temporal coding in neural systems [|ll]- Human visual systems, 
for example, have shown to classify patterns within 250 ms despite the fact that at least ten 
synaptic stages are involved from retina to the temporal brain |]T5[. The transmission times 
between two successive stages of synaptic transmission are suggested to be no more than 10 
ms on the average. This period is too short to allow rates to be determined accurately. 

The second issue is whether information is encoded in the activity of single (or very few) 
neurons or that of a large number of neurons {population or ensemble code). The population 
rate code model assumes that information is coded in the relative firing rates of ensemble 
neurons, and has been adopted in the most of the theoretical analysis |]TB[. On the contrary, 
in the population temporal code model, it is assumed that relative timings between spikes 
in ensemble neurons may be used as an encoding mechanism for perceptional processing 
[19|. A number of experimental data supporting this code have been reported in recent 
years |2l|. For example, data have demonstrated that temporally coordinated spikes 
can systematically signal sensory object feature, even in the absence of changes in firing rate 
of the spikes . 



The strong criticism against the temporal code is that spikes are vulnerable to noise 
while the rate code performs robustly in the presence of noise but with limited information 
capacity. It is well known that although firings of single neocortical neurons in vitro are 
precise and reliable, those in vivo are quite unreliable |2^. This is due to noisy environment 
in viro, which makes the reliability of neurons firings worse. In recent years, however, much 
studies have been made for the stochastic resonance (SR) |2^ p5| in which information 



transmission of signals is enhanced by background noises, against our conventional wisdom. 
SR in a neural system has been theoretically investigated [p6|- p2| . The transmission fidelity 



for weak external signals, which is evaluated by the signal-to-noise ratio (SNR) or the peak 
height of the interspike-interval (ISI) distribution, is enhanced by added noises. SR is 
supported in some physiological experiments for biological systems such as crayfish ||4^ |[44|| , 
cricket and rat . 

Although SR itself is a genetic phenomenon, its detailed character is determined by the 
three important factors: (a) kinds of systems (neurons), (b) input signal and (c) noises. As 
for the first factor of (a) neurons, SR in single neurons has been studied by using various the- 
oretical models such as the integrate-and-fire (IF) model ||28|, the FitzHough-Nagumo 



(FN) model p9 



31| and the Hodgkin-Huxley (HH) model ||32| [Q. SR in coupled or en- 



semble neurons has been also investigated by using the IF model |34]- [35], FN model 
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38| and HH model [|^. The transmission fidelity has maximum when the noise mag- 
nitude or the coupling strength is changed. It has been pointed out that the transmission 
fidelity of ensemble neurons for sinusoidal inputs with independent white noises is improved 
as the size of an ensemble is increased ^6 



As for the second factor of (b) input signals, most of theoretical studies have been made 



for analog inputs with periodic (mostly sinusoidal) or aperiodic amplitude modulation |^ 



This is because these studies have been motivated by a fact that peripheral sensory neurons 
play a role of transducers receiving analog stimulus and emitting spikes. In central neural 
systems, however, cortical neurons are reported to play a role of data-processors receiving 
and transmitting spike trains [^. There are only a few theoretical studies on SR for spike- 
train inputs [^]- ll^. The response of single IF neurons to coherent spike-train (ST) inputs 
is shown to be enhanced by an addition of weak ST noises characterized by the Poisson 
50| ||5l| or gamma distribution |52|. Quite recently, the present author has studied SR of 



ensemble HH neurons for transient spike-train inputs with independent Gaussian noise by 
using the wavelet analysis 0]. 

As for the third factor of (c) noises, it has been reported that noises are ubiquitous in 
neural systems. The origin of these noises is not clear at the moment. We may suppose, 
however, several conceivable origins of noises: (i) cells in sensory neurons are exposed to 
noises arising from the outer world, (ii) ion channels of the membrane of neurons are known 
to be stochastic (iii) the synaptic transmission yields noises originating from random 
fiuctuations of the synaptic vesicle release rate [^, and (iv) synaptic inputs include leaked 



(iii) by the Gaussian white noise |2| 



Most of existing studies on SR have simulated noises 



[0 or Orstein-Uhrenbeck 



41] 1 42]. ST noise is employed in Refs. [3^- ]53] taking account the 



currents from neighboring neurons [§7 
of the items 
(OU) noise 

item (iv). In our study, we will include the ST and white noises which may be regarded, in 
a crude sense, as analog and digital noises, respectively, with the rather different character. 

One of the controversial issues concerning cortical neurons is how the neurons may com- 
municate information by spikes with a large variability. It has been reported that the 
variability of c^, = 0.5 ~ 1.0 is observed in spike trains of non-bursting cortical neurons in 
visual VI and MT of monkey [^, which is in strong contrast with a small c„ (= 0.05 ~ 0.1) 
in motor neurons ]^. There have been much discussions how to understand the observed 
large variability: a balance between excitatory and inhibitory inputs |5^, the high physio- 
logical gain in the plot of input current vs. output frequency [0], correlation fiuctuations 
in recurrent networks ]^T|], the active dendrite conductance [^, input ISIs with the distri- 
bution of a slow- decreasing tail [^, and input ISIs with large c„ ]^. We expect that 
although there might be several origins responsible to the observed, large variability in ISI, 
noises may be one of conceivable mechanisms. 

The purpose of the present study is to investigate responses of ensemble neurons to spike- 
train inputs subject to ST and white noises, in order to get some insight to the following 
issues. 

(1) Is the effect of ST noise on responses to spike-train signals, particalrly on SR, different 
from or same as that of white noise? 

(2) Is a population or ensemble of neurons important for the fidelity of signal transmission? 

(3) Is a large variability of spikes compatible with information transmission with a fairly 
good SNR? 
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Responses of single HH neurons to various types of spike-train inputs with deterministic, 



chaotic and stochastic ISIs without noises, have been investigated ||6^. SR for coherent spike- 



train inputs has been theoretically studied with single IF neurons |5y]- |Q. We should note, 
however, that the response to applied, external stimulus of the realistic HH model [^] is 
rather different even qualitatively from that of the IF neuron . For an excitatory dc 

input /, the IF neuron which is classified as the type I, evokes the self-excited oscillation 
showing the continuous fo — I relation with a wide range of frequency fo- On the other 
hand, the HH neuron, which is classified as the type II, has the discontinuous fo — I relation 
at the critical current, above which it shows the oscillation with a fairy narrow range of 
fo- For an inhibitory dc input current, the HH neuron can fire with the so-called rebound 
process while the IF neuron cannot. Since the threshold-crossing behavior of the neuron is 
important in determining the behavior of its SR, it is necessary to re-examine SR for the 
spike-train inputs with the use of the realistic HH neuron model. Furthermore, since SR of 
single neurons is generally different from that of ensemble neurons, it is also necessary to 
investigate SR not only of single HH neurons but also of ensemble HH neurons. 

The present paper is organized as follows. In Sec. II, an adopted model for an ensemble 
of A^-unit (A^ = 1, 10, 100) HH neurons is described. Simulations for responses of ensemble 
neurons to ST signals with added ST noise, white noise, and ST plus white noises are 
reported in Sec. IIIA, IIIB and IIIC, respectively, where SR and the variability of ISIs are 
discussed. The final Sec. IV is devoted to conclusion and discussion. 



II. ENSEMBLE NEURON MODEL 



We assume a network consisting of A^-unit HH neurons which receive the same ST signals 
but independent, ST and Gaussian noises through excitatory synapses. Spikes emitted by 
the ensemble neurons are collected by a summing neuron. A similar model was previously 
adopted by several authors studying SR ||39| |Q @]. Dynamics of the membrane 



potential Vi of the HH neuron i is described by the non-linear differential equations given by 



CdVi{t)/dt 



_ rion I rps , rn 



(for 1 < i < A^) 



(1) 



where C = 1 yuF/cm^ is the capacity of the membrane. The first term /|°" of Eq.(l) denotes 

(2) 



the ion current given by 

/r = 9N.m%{V, - l^Na) + gxritiV, - Vk) + 9l{V^ - VL 



where the maximum values of conductivities of Na and K channels and leakage are (^Na = 
120 mS/cm^, gy^ = 36 mS/cm^ and gi^ = 0.3 mS/cm^, respectively; the respective reversal 
potentials are = 50 mV, Vk = —77 mV and Vl = —54.5 mV. Dynamics of the gating 
variables of Na and K channels, mi,hi and nj, are described by the ordinary differential 
equations, whose details have been given elsewhere pl |. 

The second term If^ in Eq.(l) denotes the post-synaptic current given by 



T.9siVa-V,)ait-t,m), 

m 

which is induced by an input spike with the magnitude Va given by 



(3) 
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U^{t)=Va Kt-tim), (4) 

m 



with the alpha function a{t): 

ait) = it/n) e-*/-= e(t). (5) 

In Eqs.(3)-(5) t\m = (m — 1) Tg is the m-th firing time with the input-signal ISI of Tg, the 
Heaviside function is defined by 9(t) = 1 for x > and for x < 0, and Qs, and Xg stand 
for the conductance, reversal potential and time constant, respectively, of the synapse. 

The third term If in Eq.(l) denotes added, independent noises which consist of two 
terms: 

=Y.^<^ii- tin) + V2D m- (6) 

m 

The first term of Eq.(6) expresses Poisson ST noise, whose magnitude, C, is hereafter ex- 
pressed by ^/C = QniYa — K) in terms of Qn as in Eq.(3) for a later purpose, and t"^ is the 
m-th firing time of the ST noise of the neuron i with the average ISI of The second term 
of Eq.(6) denotes Gaussian white noises with the magnitude of D given by 

< ^ >= 0, (7) 



(8) 



where the overline X and the bracket < X > denote the temporal and spatial averages, 
respectively. 

We should remark that our ensemble neuron model given by Eqs.(l)-(6) does not include 
synaptic couplings among constituent HH neurons, in contrast with the coupled ensemble 
models related discussions being given in Sec. IV. 

We assume that information is carried by firing times of spikes. Dividing the time scale 
by the width of time bin of Tb as t = = (£ — 1) Tb (£: integer), we define input and output 
signals summed over ensemble neurons within the each time bin by 



(9) 



N 

Wo{t) = (1/iv) 0(^b/2- 1 1- w I). (10) 

i=l n 

In Eqs. (9) and (10) G(t) stands for the Heaviside function, tim the m-th firing time of 
inputs, and toin the n-th firing time of outputs of the neuron i when Vi(t) crosses Vz = 
mV from below. The time bin is chosen as Tb =2.5 ms in our simulations. The fast Fourier 
transformation (FT) is performed for Wo{t) in order to get the SNR defined by 

SNR = 10 \og,o{A J An) (dB), (11) 

where Ag is the signal power spectrum at a given frequency of l/Tg and An the background 
noise level. 
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Differential equations given by Eqs.(l)-(6) are solved by the forth-order Runge-Kutta 
method by the integration time step of 0.01 ms with double precision. The initial conditions 
for the variables are given by Vi(t)= -65 mV, mj(t)=0.0526, hi{t)=0.600, nj(t)=0.313 at 
it = 0, which are the rest-state solution of a single HH neuron. Hereafter time, voltage, 
conductance, current, and D are expressed in units of ms, mV, mS/cm^, fiA/cm^, and 
/iA^/cm^, respectively. We have adopted parameters of Va = 30, Vc = —50, and Tg =2. 
Adopted values of gs, gn, D, fi^ and N will be described shortly. The simulation time for 
each run for a given set of parameters is T^j^ ~ 1500 ms (150000 xA^ time steps) and initial 
3000 A^ time steps are discarded to get asymptotic solutions. The size of sample data for 
FT analysis becomes Npjn=512 when the input ISI is chosen to be = 25 ms. A single 
simulation with A^ = 100 requires the CPU time of about 150 minutes by DOS/V PC with 
900 MHz processor. The calculated SNR is expected to be improved if the simulation time 
Tsim is increased. Unfortunately, we have not been able to adopt larger Tgi^ because of a 
limitation in our computer facility (related discussion will be presented in Sec. IV). We hope 
that our simulation reveals some of the interesting features of SR of ensemble neurons for 
spike-train inputs with added, multiple noises. 



III. CALCULATED RESULTS 
A. Spike- Train Noises 

1. SNR and SR 

Firstly we discuss the case in which ensemble HH neurons receive input signals with 
independent ST noise only. The input ISI is assume to be Tg = 25 ms because spikes with 



this value of ISI are reported to be ubiquitous in cortical brains We study sub-threshold 
inputs with gs < gth for which neurons cannot fire without added noises. The threshold value 
of gth generally depends on the input ISI, T^: for example, gth=0.0S8, 0.085 and 0.095 for 
Ts=20, 25 and 30 ms, respectively |^ . 



Raster in Fig. 1 shows firings of A^ = 100 ensemble neurons when spike-train signals of 
T, = 25 ms are applied to ensemble neurons with added ST noises of gn = 0.10, D = 0.0 
and fin = 25 ms. Neurons fire when a spike-train input plus noise or noises exceed the 
threshold level. At a glance, firings in Fig. 1 seem random. We may realize it is not true 
when firings are summed over ensemble neurons as shown in Fig. 2(b) where the output 
signal Woit) summed over a A^ = 100 ensemble is plotted. We note that Woit) includes a 
periodic component with a period of Ts=25 ms as an input signal shown in Fig. 2(a). This 
regularity is more clearly seen in its FT power spectrum shown in Fig. 3(a), which shows 
clear peaks at a fundamental frequency of l/Tg = 40 Hz and its harmonics. Information 
may be transmitted with aid of SR in a A^ = 100 neuron ensemble. 

When the size of ensemble neurons is small, however, the information transmission is 
much degraded. Figures 2(c) and 2(d) show Wo(t) for A^ = 10 and A^ = 1, respectively, 
other parameters except A^ being the same as in Fig. 2(b). Figure 2(d) for A^ = 1 , for 
example, shows that a single neuron intermittently fires, yielding 18 firings for 40 input 
spike inputs. The FT power spectra for A^ = 10 and A^ = 1 are expressed in Fig. 3(b) and 
3(c), respectively. Figures 3(a)-3(c) show that the magnitude of a peak at the fundamental 
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frequency divided by that of background noises, i.e. SNR, increases as the size of ensemble 
neurons is increased. These mean that despite of ostensibly irregular firings of single neurons, 
output signals summed over an ensemble, Wo{t), become more regular when N becomes 
sufficiently large. 

Figure 4 shows SNR as a function of Qn calculated for gg = 0.06, D = and /i„ = 25 ms 
with = 1, 10 and 100. Results for A^= land 10 are averages of ten runs. When the noise 
intensity Qn is increased from zero, neurons begin to occasionally fire by a cooperative action 
between input signals and added noises. As Qn becomes greater than the threshold level of 
gth = 0.085, ST noise alone is sufficient to trigger firings without signal inputs. When gn 
is further increased, SNR of outputs is gradually degraded. Then SNR has a maximum at 
On ~ gth, which is the characteristics of SR. For the case of = 10 and 100, we realize SR 
with the maximum in SNR for a weak noise of Qn ~ 0.07. On the contrary, for the case of 
A^ = 1, the maximum in SNR is not evident although SNR is enhanced at Qn > 0.04. 

In many non-linear systems, SNR for sinusoidal input signals is reported to obey the 
noise-intensity dependence given by p4| ||25| 



SNR = 10 logio U/X'^) expi-B/X)], (12) 

with a maximum at X^ax = B/a where X = D (the intensity of the white noise), a = 2, 
and A and B are constants depending on the model parameters. Substituting X = g"^ [oc C 
in Eq.(6)], we have tried to analyze the gn dependence of SNR for A^ = 100 obtained in 
our simulation. Dashed curves in Fig.4 show the results adopting two sets of parameters in 
Eq.(12): {a,A,B) = {2, 1.77 x lO'^, 8.45 x lO'^) and (3, 2.00 x 10-^ 1.27 x lO'^), which 
are chosen such as to locate the maximum of SNR at g.^ = 0.065. The latter choice of 
parameters with a = 3 yields the much better agreement with the data obtained in our 
simulations than the former with a = 2, although the plateau around the maximum is not 
well reproduced even in the latter. 

We have investigated the effect of input ISI on SR by changing Tg. Solid curves in Fig. 
5 denote SNRs as a function of gn for Ts=20, 25 and 30 ms obtained in our simulation and 
dashed curves those analyzed by Eq.(12) with X = g"^ and sets of parameters of {a,A,B) 
= (3, 5.01 X 10-^ 1.27 X 10-2) for T, = 20, (3, 2.00 x 10-^ 1.27 x lO'^) for T, = 25, 
and (3, 7.94 x 10-^ 1.27 x 10"^) for T, = 30. The index a = 3 is realized for all the T, 
values investigated. The maximum SNR value is decreased as T<, is increased, although the 
maximum position at gn ~ 0.065 in SNR is not changed. 

So far our discussion is confined to the sub-threshold case. We have performed simu- 
lations also for the supra-threshold inputs, adopting gs larger than the threshold value of 
gth- Figure 6 shows the gs dependence of SNR calculated for ST noise only {gn = 0.10 and 
D = 0) with fin = 25 ms, and A^ = 1, 10 and 100. When gg is increased across the threshold 
value of gth, SNR is discontinuously increased. SNR for the supra-threshold inputs is better 
than that for sub-threshold inputs, as expected. We note, however, that ensemble neurons 
with large A^ is fairly robust against weak noises relevant to SR. 



2. ISI 

Next we discuss the distribution of output ISIs of individual neurons given by 
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where toin is the n-th firing time of outputs of the neuron i. Figures 7(a)- (d) show histograms 
of output ISIs for (yfs=0.02, 0.06, 0.10 and 0.14, respectively, when ST noise of (?„ = 0.10 is 
added to ST signal (see Fig. 6). In the cases of Qs = 0.02, ISI histograms (ISIH) nearly 
obey the exponential distribution as shown by dashed curve, but it vanishes at Tom < 15 
ms because a HH neuron cannot properly respond to small-ISI inputs due to its refractory 
period On the contrary, in the cases of gs = 0.10 and 0.14, ISIH has larger magnitudes 



at Toin ~ Ts, which may be approximately expressed by the gamma- type distribution. In 
the case of Qs = 0.06, ISIH includes not only the truncated exponential distribution but 
also finite contributions at multiples of Tg. This change in the distribution is more clearly 
seen in the Qs dependence of the average (/io) and RMS values (cTq) of output ISIs, which 
are plotted in Fig. 8. Both /io and cTq are almost constant at Qs < 0.08, and at Qs ~ 0.10 
they are suddenly decreased. When ISIH of output spikes for gg < gth is expressed by the 
truncated exponential distribution given by 

P(T) oc e(T - Tl) exp(-sr), (14) 

©(■) being the Heaviside function and Tl the lower bound, the average and RMS values 
are given by /^o = (1 + sTi)/s and cTq = 1/s, which yield /io = 40 and a = 25 ms for 
1/s = 25 and T^ = 15 ms. These figures are a little different from /io ~ 50 and a ~ 35 ms 
for Qs < 0.8 shown in Fig. 8. The difference may be attributed to the extra contribution at 
2 Tg obtained in our simulation, as shown in Figs. 7(a) and (b). The variability defined by 
Cvo = cTo/fio is 0.655, 0.703, 0.307 and 0.212 for ^,=0.02, 0.06, 0.10 and 0.14, respectively. 
When comparing Fig. 6 and Fig. 8, we note that even if the variability of ISIs of individual 
neurons is considerable, output signals summed over a large-scale ensemble [PFo(^) in Eq-(IO)] 
may carry information with a fairly good SNR. For example, in the case of Qs = 0.06, we 
get SNR=17.4 dB for Cyo = 0.703. This is an advantage of a neuron ensemble. 



B. White Noises 

1. SNR and SR 

Next we discuss SR for Gaussian white noise, which is applied to our ensemble neurons 
instead of ST noise. Neurons occasionally fire when signal plus noise exceed the threshold 
level. Firings of neurons for white noises are similar to those to the ST noises shown in Fig. 
1. SNR calculated as a function of D, the intensity of the white noise, for = 1, 10 and 100 
is plotted in Fig. 9. When the white noise intensity is increased from zero, SNR is rapidly 
enhanced with a maximum at D ~ 2 followed by a gradual decrease, which is a typical SR. 
Although the calculated SNR shows the SR behavior irrespective of N, it is more evident 
for larger A^. 

The dashed curve in Fig. 9 expresses SNR calculated by Eq.(12) with a set of parameters 
of [a, A, B) = {2, 5890, 5), which are chosen such as to agree with the maximum position at 
D = 2.5 in SNR for A^ = 100 obtained by our simulation. The agreement between the result 
of a = 2 and our data seems satisfactory. This value of a = 2 agrees with the results of 
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SR for sinusoidal input signals in HH neurons as well as those realized in many 



25 



non-linear systems 

Fig. 10 shows the Qs dependence of SNR for white noises only {D = 2 and Qn = 0) 
with = 1, 10 and 100. SNR is gradually increased as increasing Qg. In contrast with the 
case for ST noise shown in Fig. 6, there is no significant changes in SNR at the threshold 
level shown by the vertical, dashed line. A comparison of Fig. 6 and Fig. 10 shows that Qs 
dependence of SNR for ST noise is different from that for white noise. 



2. ISI 

Figures ll(a)-(d) show histograms of output ISls for gs=0.02, 0.06, 0.10 and 0.14, respec- 
tively, when white noise of D = 2 is added to ST signal (see Fig. 10). ISIHs for gg = 0.02 
and Qs = 0.06 show a typical behavior with peaks at multiples of Tg whose magnitudes de- 
crease exponentially It is noted that the distribution extends up to 200 ms. As gs 
is increased across gth, magnitudes of the main peak at Tg are much increased as expected. 
Figure 12 shows the gg dependence of the average {fio) and RMS values (cTo) of ISI and the 
variability (c^o)- As increasing gg, both /Xq and do are gradually decreased with no sudden 
changes at gg ~ gt^. The variability is 0.813 and 0.710 for gs=0.02 and 0.06, respectively. As 
gs becomes larger than gth, ISIH has a larger magnitude at Tom ~ Tg and then the variability 
is decreased: Cyo becomes 0.528 and 0.343 for gs=0.10 and 0.14, respectively. Comparing 
Fig. 12 to Fig. 8, we note that gg dependence of fio, cTq and c^o for white noises is rather 
different from that for ST noise. 



C. Spike- Train plus White Noises 

Since neurons in real neural systems are in the environment with various kinds of noises 
as discussed in Sec. I, it is necessary to examine various effects of multiple types of noises. 
Taking into account independent Gaussian and OU noises, Liu, Hu and Wang have investi- 
gated the effect of spatial correlation on SR in coupled HH neurons |^2|. Recently Lindner 
and Schimansky-Geier have included, in the ensemble IF model, the additive and signal- 



coded noises, which are expressed by \/2Di ^i(t) and \J D2 s(t) ^2(^)5 respectively, in terms 
of the external sinusoidal signal s{t) and Gaussian noises with the magnitudes of Dn 
(n = l,2). 

In previous Sec. IIIA and Sec. IIIB, we have separately discussed ST and white noises. 
Now we simultaneously add both the noises to our ensemble neurons. Figure 13 shows the 
three-dimensional plot of SNR for A^ = 100 as functions of and D. In the case of D = 
(ST noise only), SNR has a maximum at ~ 0.07, as shown in Fig. 4. In the case of gn = 
(white noises only), on the other hand, SNR has a maximum at Z) ~ 2 as shown in Fig. 
9. The contour plot depicted in the base of Fig. 13 shows that SNR is rapidly increased 
from zero as ST or white noise is increased. SNR in the presence of weak white noise of 
< < 1 is enhanced by a further addition of ST noise and it depends considerably on gn. 
With stronger white noise of D > 1, SNR is slightly enhanced by an addition of weak ST 
noise of gn ~ 0.01 although it only weakly depends on gn at gn > 0.02. SNR in the presence 
of weak ST noise with gn < 0.05 is much enhanced by a further addition of white noise. We 
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note, however, that white noise enhances SNR even in the presence of stronger ST noise of 
gn > 0.1, where SNR is decreased by excess ST noise for D = 0. These clearly show that 
white noise is more effective for SR than ST noise. 



IV. CONCLUSION AND DISCUSSION 

In previous Sec. Ill, the simulation time of each run has been limited to be 1500 ms 
(150000 xA^ time steps) because of a limitation in our computer facility. It is, however, 
possible, to extend the simulation time when the simulation is made only for single {N = 1) 
neurons. Figure 14 shows SNR as a function of Qn for ST noise added to single HH neurons, 
which are calculated with the simulations times of Tgim = 1500, 3000, 6000 and 12 000 ms, 
yielding FT-data sizes (Nft) of 512, 1024, 2048 and 4096, respectively. We note that as 
Tsim becomes larger, SNR is improved, in particular, its maximum becomes more evident. 
The dashed curve expresses SNR calculated by using Eq.(12) with X = g^^ and a set of 
parameters of {a,A,B) =(3, 6.31 x 10~^, 9.75 x 10~^), which are chosen to reproduce SNR 
calculated for Tsim = 12000 ms with the maximum at gn = 0.057. Again the index of a = 3 
is realized for ST noise added to single neurons. We note from Figs. 4 and 14 that SR 
becomes more significant if the duration of applied, coherent spike trains is longer and/or 
the size of ensemble neurons is larger. Even if the duration of applied signal is not long, 
SNR may be improved if the size of ensemble neurons is sufficiently large. This is more 
evident when the input signal is transient spike train, as recently demonstrated in Ref . [54] . 

In a summary, we have numerically investigated SR responses of an ensemble of HH 
neurons to spike-train signals with added ST and/or white noises. Our conclusions against 
the three issues raised in the Introduction are summarized as follows: 

(1) Comparisons of Figs. 4, 6, 7 and 8 for ST noise with Figs. 9, 10, 11 and 12 for white noise, 
respectively, clearly show both the difference and the similarity between the effects of ST 
and white noises. Although SR is a genetic phenomenon, its detailed behavior depends on 
kinds of the input signal and added noises. When analyzing SNR obtained in our simulations 
with the use of Eq.(12), we get a = 3 for ST noise, which is different from a = 2 for white 
noise. ST noise is less effective for SR than the white noise (Fig. 13). 

(2) SNR is more improved as the size of ensemble is larger. In a large neuron ensemble, the 
transmission fidelity for supra-threshold inputs is not significantly degraded by weak noises 
responsible to SR for sub-threshold inputs (Figs. 6 and 10). 

(3) The variability of ISIs of individual neurons for sub-threshold inputs is rather large 
(cyo ^ 0.8). Nevertheless the output Wo summed over an ensemble may carry information 
with a fairly good SNR. 

The item (2) is consistent with the results of SR for transient spike-train signal |Q and for 
analog signals [^, showing that a population of neurons plays a very important role for 



the transmission of spike-train inputs both with sub- and supra-threshold levels. It is worth 
to note that this enhancement in SNR is due to the pooling effect because our ensemble 
neuron model have no couplings among HH neurons. The item (3) shows that noise may 
be one of conceivable mechanism yielding a large variability observed experimentally ||58|| . 
Even when the variability of firings of individual neurons is considerable, firings summed 
over a ensemble may carry information with a fairly good SNR enhanced by SR and pooling 
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effects. Thus the large variabihty and high SNR are not incompatible in a large-scale neuron 
ensemble. 

The present study entirely relies on simulations. It would be interesting to theoretically 
elucidate the dependence of the index a on a kind of added noises mentioned above. However, 
conventional approaches having been employed for a study of SR such as the rate-equation 



and linear- response theories ||2J]- ||2^ , do not work on our case. We leave its analytical study 
as our future problem. 
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FIGURES 



FIG. 1. Raster showing firings in N = 100 ensemble neurons with D = 0.0, gn = 0.10, /i„ = 25 
ms and gg = 0.06 (ST noise only). 

FIG. 2. (a) An input signal Wi{t), and (b) output signals Wo{t) for N = 100, (c) iV = 10 
and (d) = 1, with D = 0.0, gn = 0.10, /U = 25 ms and gg = 0.06, results of (b) and (c) being 
multiplied by factors of 5 and 2, respectively. 

FIG. 3. Fourier power spectra for (a) N = 100, (b) = 10 and (c) A = 1, with D = 0.0, 
gn = 0.10, iiji = 25 ms and gg = 0.06. 

FIG. 4. The c/„ dependence of SNR for ST noise with D = 0.0, /x„ = 25 ms and gg = 0.06, 
results for A = 1 and 10 being averages of ten runs. Dashed curves express SNR calculated by 
Eq.(12) with X = g^ ioi a = 2 and 3 (see text). 

FIG. 5. The gn dependence of SNR for ST noise and input signals with Tg =20, 25 and 30 
ms (A = 100, D = 0.0, Hn = 25 ms and gg = 0.06), dashed curves expressing SNR calculated by 
Eq.(12) with X = gl ioi a = 3 (see text). 

FIG. 6. The gg dependence of SNR for ST noises with D = 0.0, gn = 0.10 and = 25 ms, 
results for A^ = 1 and 10 being averages of ten runs and the dashed line the threshold value of 
gth = 0.085. 

FIG. 7. Histograms of output ISIs of A = 100 ensemble neurons for (a) gg = 0.02. (b) 0.06, 
(c) 0.10 and (d) 0.14, with input signals of Ts=25 ms and added ST noise ((/„=0.10, D = 0). 
Dashed curves in (a) and (b) express the exponential distribution given by P{T) oc exp(— T/25) 
and histograms of (c) and (d) are multiplied by a factor of 1/5. 

FIG. 8. The gg dependence of the average {fio) and RMS values (cto) of ISI, and the variability 
(cvo) when ST noise of gn = 0.10 is added to N = 100 ensemble, the dashed line denoting the 
threshold value of gth = 0.085. 

FIG. 9. The D dependence of SNR for white noises with (/„ = 0.0, = 25 ms and gg = 0.06, 
results for A = 1 and 10 being averages of ten runs. The dashed curve expresses SNR calculated 
by Eq.(12) with X = D ioi a = 2 (see text). 

FIG. 10. The gg dependence of SNR for white noises with D = 2.0, gn = 0.0 and /U„ = 25 
ms, results for AT = 1 and 10 being averages of ten runs and the dashed line the threshold value of 
gth = 0.085. 
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FIG. 11. Histograms of output ISIs of iV = 100 ensemble neurons for (a) Qs = 0.02, (b) 
0.06, (c) 0.10 and (d) 0.14, with input signals of Ts=25 ms and added white noise {D = 2, gn=0), 
histograms of (c) and (d) being multiplied by a factor of 1/3. 

FIG. 12. The gg dependence of the average {no) and RMS values (cTo) of ISI, and the variability 
(cvo) when white noises of D = 2.0 is added to N = 100 ensemble, the dashed line denoting the 
threshold value of gth = 0.085. 

FIG. 13. The three-dimensional plot of SNR as functions of gn and D for /x„=25 ms and 
gs = 0.06, the contour plot being shown in the base of the figure. 

FIG. 14. The gn dependence of SNR for single (A^ = 1) HH neurons with ST noise calculated 
by changing Tgim (ms), the simulation time for each run {D = 0, = 25 ms and gs = 0.06), the 
result for Tgim = 1500 ms being the average of ten runs. The dashed curve denotes SNR given by 
Eq.(12) with X = g^ and a = 3 (see text). 
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